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Dynamic Image Composition Apparatus and Method 

Cross Reference to Related Application 

This application is a continuation of 
5 International PCT Application No. PCT/ JP 9 9 / 0 1 1 5 3 
filed on March 10, 1999. 

Background of the Invention 
Field of the Invention 

10 The present invention relates to a dynamic 

image composition apparatus for combining one or 
more dynamic images and displaying them on a screen 
and a method thereof. 

15 Description of the Related Art 

Recently, with the spread of personal 
computers and workstations, the number of users who 
use the reproduction software of dynamic image data 
to reproduce an image while moving the image on a 

20 screen has been increasing. Conventional 
reproduction software has a function to combine and 
store both the data of an image component to be 
displayed and the data of the movement and to transmit 
the combined data to a plotting device when the image 

25 is reproduced. 
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However, when a complex movement, such as when 
an image component moves while vertically vibrating, 
is reproduced, a last movement must be manually 
composed in advance. Therefore, to represent a 
5 plurality of different complex movements when an 
image is reproduced, all kinds of movements are 
composed in advance and each image component is 
displayed according to a respective predetermined 
movement when the image is reproduced. Even when 

10 a plurality of image components are composed of the 
same movement element, such as translation, etc., 
each movement must be individually composed. 

As described above, in the conventional 
reproduction software, a great amount of movement 

15 data must be prepared to represent many complex 
movements. A new movement cannot also be composed 
when an image is reproduced, nor can a movement also 
be flexibly modified . Furthermore, the conventional 
reproduction software has a problem that there is 

20 no method for sharing the same movement element with 
a plurality of image components. 

Summary of the Invention 

It is an object of the present invention to 
25 provide a dynamic image composition apparatus for 
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improving the versatility of each movement element 
and for easily representing a complex movement when 
displaying a plurality of dynamic images on a screen 
and a method thereof. 
5 the dynamic image composition apparatus of the 

present invention comprises a plurality of plot 
information generating devices, one or more image 
management devices and a plotting device, and it 
combines and displays one or more images. 
10 Each plot information generating device 

generates plot information used to plot a dynamic 
image . Each image management device manages the image 
data of each image and generates the plot information 
at a present time of each image by combining one 
15 or more pieces of plot information generated by one 
or more of a plurality of plot information generating 
devices. The plotting device receives both the image 
data and plot information at a present time from 
the image management device and plots the image data 
20 based on the plot information at a present time. 

Brief Description of the Drawings 

Fig. 1 shows the basic configuration of the 
dynamic image composition apparatus of the present 
25 invention; 



Fig. 2 shows the configuration of the first 
dynamic image composition apparatus; 

Fig. 3 shows the configuration of the second 
dynamic image composition apparatus; 

Fig. 4 shows the configuration of the third 
dynamic image composition apparatus; 

Fig. 5 shows the configuration of the fourth 
dynamic image composition apparatus; 

Fig. 6 shows the first dynamic image 
composition; 

Fig. 7 is a flowchart showing the first plot 
update process; 

Fig. 8 is a flowchart showing an event process; 
Fig. 9 is a flowchart showing the first plot 
information generating process; 

Fig. 10 is a flowchart showing a plot 
information function obtaining process; 

Fig. 11 shows the second dynamic image 
composition; 

Fig. 12 is a flowchart showing the second plot 
information generating process; 

Fig. 13 shows a plot information string; 
Fig. 14 is a flowchart showing a plot 
information string obtaining process; 

Fig. 15 shows the third dynamic image 
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composition; 

Fig. 16 is a flowchart showing the second plot 
update process; 

Fig. 17 is a flowchart showing the third plot 
information generating process; 

Fig. 18 shows the fourth dynamic image 
composition; 

Fig. 19 is a flowchart showing the fourth plot 
information generating process; 

Fig. 20 shows the first dynamic image; 

Fig. 21 shows the fifth dynamic image 
composition; 

Fig. 22 shows the second dynamic image; 

Fig. 23 shows the third dynamic image; 

Fig. 24 shows the configuration of an 
information processing device; 

Fig. 25 shows an example of storage media; and 

Fig. 26 shows the configuration of the fifth 
dynamic image composition apparatus. 

Description of Preferred Embodiments 

The preferred embodiments of the present 
invention are described in detail below with 
reference to the drawings. 

Fig. 1 shows the basic configuration of the 
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dynamic image composition apparatus of the present 
invention. The dynamic image composition apparatus 
shown in Fig. 1 comprises a plurality of plot 
information generating devices 1, one or more image 
5 management devices 2 and a plotting device 3, and 
it combines and displays one or more images. 

Each plot information generating device 1 
generates plot information used to plot a dynamic 
image. Each image management device 2 manages the 
10 image data of each image and generates the plot 
information at a present time of each image by 
combining one or more pieces of plot information 
generated by one or more of a plurality of plot 
information generating devices 2. The plotting 
15 device 3 receives both the image data and plot 
information at a present time from the image 
management device 2 and plots the image data based 
on the plot information at a present time. 

The plot information are generated for each 
20 image and includes information about the position 
coordinates on a screen of an image. When an image 
is reproduced, each of the plurality of plot 
information generating device 1 generates plot 
information for plotting a different movement 
25 element, and the image management device 2 generates 
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one piece of plot information by combining a 
plurality of pieces of plot information generated 
by the plurality of plot information generating 
devices 1. 

5 For example, if the first and second plot 

information generating device generate plot 
information for indicating the vertical vibration 
of a sine wave and plot information for indicating 
the rightward shift , respectively, plot information 
10 obtained by combining those pieces of plot 
information indicates a rightward shift with a 
vertical vibration along the locus of a sine wave. 

The plotting device 3 plots image data based 
on the plot information composed in this way and 
15 represents a composed movement. If there are a 
plurality of image management devices 2 , theplotting 
device 3 plots the image data based on plot 
information corresponding to each piece of image 
data and combines a plurality of images on a screen. 
20 In this way, a complex movement can be easily 

generated by combining a plurality of pieces of plot 
information generated by a plurality of plot 
information generating devices 1, in real time when 
an image is reproduced. Since the plurality of image 
25 management devices 2 can use one plot information 



generating device 1, one movement element can be 
used to plot a plurality of different images. 

Alternatively, a plot information generating 
device 1 can also be handled as a movement component 
5 for plotting an individual movement, and a plot 
information generating device 1 can also be 
added/deleted according to an event generated while 
a dynamic image is reproduced. Therefore, the 
movement of an image can be modified by a user's 

10 input operation, etc. 

For example, the plot information generating 
device 1 shown in Fig. 1 corresponds to the plot 
information generating unit 23 shown in Fig. 2 and 
the plot information generating unit 41 shown in 

15 Fig. 4, which are both described later. The image 
management device 2 corresponds to the image 
management unit 11 shown in Fig. 2. The plotting 
device 3 corresponds to the plotting unit 12, VRAM 
(video random access memory) 13 and display 14 which 

20 are shown in Fig. 2. 

According to the present invention, a 
plurality of plot information generation units are 
provided for each image component, and the movement 
of each image component is composed in real time 

25 when an image is reproduced. For plot information, 
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the position, size, rotation angle, color, 
sequential relationship, etc. , of an image component 
are used, and the movement of each image component 
can be determined by providing plot information at 
5 each time . A complex movement can be easily generated 
by combining in real time a plurality of pieces of 
plot information generated by the plurality of plot 
information generating units. A movement element 
can be widely used by enabling the same movement 

10 element to be referred by a plurality of plot 
information generating units. 

Fig. 2 shows the configuration of a dynamic 
image composition apparatus based on absolute plot 
information. The dynamic image composition 

15 apparatus shown in Fig. 2 comprises one or more image 
management units 11, a plotting unit 12, a VRAM 13 
and a display 14. 

The image management unit 11 is provided for 
each image component, and, for example, it passes 

20 both image data and plot information at a present 
time to the plotting unit 12 at appropriate intervals 
such as once per frame, etc., or at dynamically 
determined intervals. The plotting unit 12 writes 
the image data, received from each image management 

25 unit 11, in the VRAM 13 based on the plot information 
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and displays the data on the screen of the display 
14 . 

The image management unit 11 includes an image 
source 21, a memory 22 andoneor more plot information 
5 generating units 23. The image source 21 is, for 
example, a still image memory , a mot ion picture image 
decoder, etc., and it generates image data to be 
written in the VRAM 13. Therefore, the data in the 
image source 21 include arbitrary images, such as 

10 a still image, motion picture image, character, 
symbol, etc. 

The plot information generating units 23 are 
linked to one another in an order relation. Each 
plot information generating unit 23 calculates the 

15 absolute plot information at apresent time according 
to a corresponding movement element, adds the 
calculation result at a present time to the plot 
information passed by a higher-order plot 
information generating unit 23 and passes the 

20 information to a lower-order plot information 
generating unit 23. 

The highest-order plot information generating 
unit 23 reads the plot information at a previous 
time from the memory 22, calculates plot information 

25 at a present time based on the information and passes 
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the information to a lower-order plot information 
generating unit 23 . The plot information at a present 
time outputted by the lowest-order plot information 
generating unit 23 is passed to the plotting unit 
12 and is simultaneously written in the memory 22. 

In this case, the order, type and number of 
the plot information generating units can be fixed 
or can be dynamically changed according to time, 
by a user's operation, etc. The plot information 
generating unit 23 can be configured by software 
or hardware. 

The dynamic image composition apparatus shown 
in Fig. 2 can be implemented, for example, by the 
configuration shown in Fig. 3. The dynamic image 
composition apparatus shown in Fig. 3 further 
comprises a plot information string management unit 
31 in addition to the constituent components shown 
in Fig. 2. 

The plot information string management unit 
31 stores one or more plot information strings 32, 
and these plot information strings 32 are identified 
by identifiers (indexes) . The plot information 
string 32 is a list of a plurality of pieces of plot 
information at arbitrarily discrete times, and it 
describes respective pieces of plot information at 
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each time of, for example, 0, 10, 60 and 65 seconds. 

Each plot information generating unit 23 
stores both an identifier 33 for referring to the 
plot information string 32 and a modification 
5 parameter 34 for modifying plot information. At a 
specific time, the plot information generating unit 
23 extracts two pieces of plot information before 
and after the time from the plot information string 
32 in the plot information string management unit 

10 31 corresponding to the identifier 33. Then, the 
plot information generating unit 23 calculates plot 
information at a present time by a method of 
performing interpolation using the extracted plot 
information, etc. 

15 Then, the plot information generating unit 23 

enlarges or reduces the calculated plot information 
by the parameter 34, adds the calculation result 
at a present time to the plot information passed 
by a higher-order plot information generating unit 

20 23 and passes the information to a lower-order plot 
information generating unit 23. The parameter 34 
can be not only applied to plot information itself, 
but it can also be applied to a time when the plot 
information is extracted. By changing a time in this 

25 way, the movement speed of an image can be changed. 
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Fig. 4 shows a dynamic image composition 
apparatus based on the difference between two pieces 
of plot information. The dynamic image composition 
apparatus shown in Fig. 4 comprises one or more image 
management units 11, a plotting unit 12, a VRAM 13 
and a display 14 like the dynamic image composition 
apparatus shown in Fig. 2. 

The image management unit 11 includes an image 
source 21, a memory 22, one or more plot information 
generating units 41 and adders 42 and 43. Each plot 
information generating unit 41 calculates the 
difference in plot information (difference plot 
information) between a previous time and a present 
time according to a corresponding movement element, 
and adds the difference to the adder 43. 

The adder 43 totals a plurality of pieces of 
the difference plot information at a present time 
outputted by the plot information generating units 
41, and the adder 42 obtains plot information at 
a present time by adding the totaled difference plot 
information at a present time to plot information 
at a previous time read from the memory 22. The plot 
information at a present time outputted from the 
adder 42 is passed to the plotting unit 12 and is 
simultaneously stored in the memory 22. 
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In this case, the type and number of the plot 
information generating units 41 can be fixed or can 
be dynamically changed according to time , by a user ' s 
operation, etc. The operational order of the plot 
5 information generating units 41 does not have to 
be specially designated and they can also be 
operated in parallel. The plot information 
generating units 41 can be configured by software 
or hardware. 

10 The dynamic image composition apparatus shown 

in Fig. 4 can be implemented, for example, by a 
configuration, as shown in Fig. 5. 

The dynamic image composition apparatus shown 
in Fig. 5 further comprises the plot information 

15 string management unit 31 shown in Fig . 3 in addition 
to the constituent components shown in Fig. 4. 

Each plot information generating unit 41 
stores both an identifier 33 for referring to the 
plot information string 32 and a modification 

20 parameter 34 for modifying plot information like 
the plot information generating unit 23 shown in 
Fig. 3. The plot information generating unit 41 
calculates difference plot information at a present 
time by a method of performing interpolation based 

25 on the plot information extracted from the plot 
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information string management unit 31 using the 
identifier 33, etc. Then, the plot information 
generating unit 41 enlarges or reduces the calculated 
difference plot information by the parameter 34 and 
outputs the calculation result to the adder 43. 

Next, the operation of the dynamic image 
composition apparatus described above is described 
in detail. Here, a plot process in the case where 
the image management unit 11 and plotting unit 12 
are configured by reproduction software is mainly 
described . 

It is assumed that the data of the image source 
21, the data of the plot information string 
management unit 31, the programs of the plot 
information generating units 23 and 41, the program 
of the plotting unit 12, etc., are already read and 
expanded in the memory of a computer. For example, 
if the image source 21 is an MPEG (Moving Picture 
Experts Group) decoder, motion picture data after 
image expansion are read into the memory. 

The plotting unit 12 stores a variable in order 
to receive an event notice from another event control 
unit, such as an event loop, etc. For the event, 
an arbitrary form, such as a user's input operation, 
interruption by the system, etc., and the event is 
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not limited to a specific form. 

Although for the plot update interval, a 
specific value dt is used, the same fundamental 
algorithm can be applied even if an update interval 
is dynamically changed depending on the function 
of reproduction hardware, etc. Generally, the longer 
the update interval, the smaller the plotting 
frequency and the higher the plotting speed. 
Therefore, a real time process can be implemented 
by appropriately adjusting an update interval. 

Although for plot information, 

two-dimensional coordinates corresponding to the 
position at which an image is displayed are used, 
the same fundamental algorithm can also be applied, 
even if other plot information, such as the size, 
rotation angle, etc., of an image is used. 

Although for the data included in the plot 
information string 32, an identifier, time and 
two-dimensional coordinate string are used, the 
overall algorithm does not change, even if 
information indicating a more complex movement is 
included. Since the plot information generating 
units 23 and 41 store respective unique internal 
times and coordinate spaces, different movements 
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can be represented by one plot information string 
32 . 

Fig. 6 shows a dynamic image composition 
process in the case where a plot information function 
5 is used instead of the plot information string 32 
in the configuration shown in Fig. 3. The plot 
information function management unit 51 shown in 
Fig. 6 stores one or more plot information functions 
52 in the form of a list, and these plot information 
10 functions 52 can be identified by identifiers. 

The plotting unit 12 stores a list 61 of pointers 
to an arbitrary number of image management units 
11, a variable 62 for receiving an event notice and 
an image update interval 63. A pointer plmagei 
15 (i = l,2,...,M) included in the list 61 indicates an 
image management unit #i. 

Each image management unit 11 stores the data 
64 of the image source 21, the most recent plot 
coordinates 65 at a previous time corresponding to 
20 the memory 22, the plot coordinates 66 and the 
highest-order image information generating unit #1, 
and the plot information generating unit #i 
(i = l,2, . . . ,N-1) stores pointer lpi to a lower- order 
plot information generating unit #(i+l) . However, 
25 the lowest-order plot information generating unit 
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#N stores no pointer to another plot information 
generating unit 23. 

Each plot information generating unit #i 
( i = l , 2 , . . . , N ) stores a plot information function 
5 identifier pfk ( k=l , 2 , . . . , K ) , a speed parameter 
speedi, scale parameters x_scalei and y_scalei and 
an internal time t_lasti. 

Since the identifier pfk corresponds to the 
plot information function 52 of the plot information 

10 function management unit 51, each plot information 
generating unit 23 can refer to an arbitrary 
information function 52. Therefore, one plot 
information function 52 can sometimes be referred 
by a plurality of plot information generating units 

15 23 in one image management unit 11 and can sometimes 
be referred by the respective plot information 
generating units 23 in a plurality of image 
management units 11. 

Fig. 7 is a flowchart showing the plot update 

20 process of the dynamic image composition apparatus 
shown in Fig. 6. M pieces of image data 64 of image 
management units #1-#M are sequentially plotted on 
coordinates generated via plot information 
generating units #1-#N by one plot update process. 

25 A loop a corresponds to a process of calling up each 
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plot management unit 11 and the process is repeated 
M times. 

At loop a, the image management unit 11 assigns 
the last plot coordinates (x_last, y_last) at a 
5 previous time to plot coordinates (x, y) (step SI) 
and it performs an event process (step S2) . In the 
event process, event information which is notified 
to the plotting unit 12 during an update interval 
dt and stored in a variable Event, is identified 

10 and the plot information generating units 23 are 
dynamically reorganized, if required. The details 
of this event process are described later. 

Then, the highest-order plot information 
generating unit #1 is called up and the change of 

15 the plot coordinates during the update interval dt 
is calculated (step S3) . At this time, if there are 
lower-order plot information generating units 23, 
the units are recurrently called up and plot 
coordinates (x, y) outputted by the lowest-order 

20 plot information generating unit #N are passed to 
the plotting unit 12 as plot coordinates at a present 
time . The details of this plot information generating 
process are described later. 

Then, the image management unit 11 assigns the 

25 obtained coordinates (x, y) to coordinates (x_last, 



20 



y_last) (step S4), and the plotting unit 12 plots 
the image data 64 at the position of the coordinates 
(x, y) (step S5) . 

When the loop a processes of all image 
management units 11 are completed, the plotting unit 
12 clears the variable Event in order to receive 
a new event notice (step S6) and terminates the 
process . 

Fig. 8 is a flowchart showing the event process 
in step S2 shown in Fig. 7. The event information 
stored in the variable Event of the plotting unit 
12 includes both the identifier of the image data 
64 and a flag indicating that a new plot information 
generating unit 23 should be generated or that an 
existing plot information generating unit 23 should 
be deleted. The event information also includes 
additional information for designating a plot 
information generating unit 23 to be 
generated/deleted . 

On receipt of the event information from the 
plotting unit 12, the image management unit 11 judges 
from the identifier whether the image data 64 being 
processed are the target of the event notice (step 
Sll) . If the image data 64 being processed are not 
the target, the image management unit 11 terminates 
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the process. If the image data are the target, the 
image management unit 11 adds/deletes a plot 
information generating unit 23 using both the flag 
and additional information. 
5 Here, the image management unit 11 judges 

whether the flag indicates the addition of a plot 
information generating unit (step S12). If it is 
judged that the flag indicates the addition, the 
image management unit 11 adds a plot information 

10 generating unit 23 designated by the additional 
information (step S13) and terminates the process. 
If it is judged that the flag does not indicates 
the addition, the image management unit 11 deletes 
a plot information generating unit 23 designated 

15 by the additional information (step S14) and 
terminates the process. 

The addition/deletion of a plot information 
generating unit 23 can be implemented, for example, 
by adding data to the list of plot information 

20 generating units 23 stored by the image management 
unit 11 and deleting data from the list. At this 
time, pointers between plot information generating 
units 23 are reorganized, if required. 

The complex movement of an image can be 

2 5 dynamically changedbysucha dynamic reorganization 
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process of plot information generating units 23. 
For example, by deleting a plot information 
generating unit 23 only for a single vibration or 
only for a parallel shift from the image management 
5 unit 11 for an image which is obtained by combining 
the single vibration and parallel shift and which 
moves in the form of a sine wave, the present movement 
of the image can be transferred to another simpler 
movement. By adding a plot information generating 

10 unit 23 for single vibration to the image management 
unit 11 of an image which moves in parallel, the 
present movement of the image can be transferred 
to another more complex movement. 

Fig. 9 is a flowchart showing the plot 

15 information generating process in step S3 shown in 
Fig. 7. The highest-order plot information 
generating unit #1 executes a process using both 
an update interval dt and plot coordinates (x, y) 
as inputs, and outputs updated plot coordinates (x, 

20 y) . 

The plot information generating unit #1 first 
multiplies the update interval dt by a parameter 
speedl to convert a global update interval dt to 
the internal update interval dtl of the plot 
25 information generating unit #1 {step S21). 
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Then, the plot information generating unit #1 
obtains a plot information function fl(t_last, dt, 
x, y) corresponding to a plot information function 
identifier pfl from the plot information function 
5 management unit 51 (step S22) . This plot information 
function obtaining process is described later. Then, 
the plot information generating unit #1 calculates 
new plot coordinates (x, y) according to the 
following eguation using an internal time t_lastl 
10 calculated at a previous time, the internal update 
interval dtl and the inputted plot coordinates (x, 
y) (step S23) . 

(x, y) = fl (t_lastl, dtl, x, y) (1) 

15 

Equation (1) indicates that x and y are 
calculated as functions of t_lastl, dtl, x and y. 
For f 1 (t_lastl, dtl, x, y) , for example, a function 
in which x=0, y=sin ( t_last 1+dt 1 ) , is used. 

20 Then, in order to convert the obtained plot 

coordinates (x, y) from the internal coordinate space 
to a global coordinate space, x and y are multiplied 
by a parameter x_scalel and y_scalel, respectively, 
and the results are assigned to x and y, respectively 

25 (step S24) . 
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Then, the plot information generating unit #1 
updates the internal time by assigning 
t_lastl=t_lastl+dtl (step S25) and judges whether 
there is a lower-order plot information generating 
5 unit 23 (step S26) . In this case, if there is a pointer 
lpl to the lower-order information generating unit 
23, it is judged that there is a lower-order plot 
information generating unit 23. If there is no 
lower-order plot information generating unit 23, 

10 the plot coordinates (x, y) are outputted as the 
result of one update process. 

If there is a lower-order plot information 
generating unit 23, the plot information generating 
unit #1 calls up the lower-order plot information 

15 generating unit 23, provides the lower-order plot 
information generating unit 23 with both the update 
interval dt and obtained plot coordinates (x, y) 
as inputs and makes the lower-order plot information 
generating unit 23 execute the same plot information 

20 generating process (step S27) . In this case, the 
plot information generating process shown in Fig. 
9 is recurrently called up and the process of a plot 
information generating unit #i is executed. 

At this time, the plot information generating 

25 unit #i calculates dtl=dt* speedi in step S2 1 , obtains 
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a plot information function fk(t_last, dt, x, y) 
corresponding to the identifier pf k in step S22 and 
calculates the plot coordinates (x, y) according 
to the following equation in step S23. 

5 

(x, y) = fk(t_lasti, dtl, x, y) (2) 

The plot information generating unit #i 
calculates x=x*x_scalei and y=y*y_scalei in step 

10 S24, calculates t_lasti=t_last i + dt 1 in step S25 and 
judges whether there is a pointer lpi in step S26. 

If in step S26 there is a lower-order plot 
information generating unit 23, theplot information 
generating unit #i calls up the lower-order plot 

15 information generating unit 23. If there is no 
lower-order plot information generating unit 23, 
the plot information generating unit #i outputs the 
obtained plot coordinates (x, y) to the original 
higher-order plot information generating unit 23 

20 and terminates the process. 

On receipt of the plot coordinates from the 
lower-order plot information generating unit 23, 
the higher-order plot information generating unit 
23 sequentially passes the plot coordinates to other 

25 higher-order plot information generating units 23 
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and the highest plot information generating unit 
#1 outputs the received plot coordinates as the 
result of one update process. 

By such a plot information generating process, 
a plurality of plot information generated by a 
plurality of pieces of plot information generating 
units 23 can be combined in real time and they can 
be supplied to the plotting unit 12. Therefore, the 
complex movement of an image can be easily generated 
by automatically repeating the update of the image. 

Fig. 10 is a flowchart showing the plot 
information function obtaining process in step S22 
shown in Fig. 9 . When the plot information generating 
unit #i passes the identifier pfk to the plot 
information function management unit 51, the plot 
information function management unit 51 executes 
the loop a process. Loop a is repeated K times in 
correspondence with the number of plot information 
functions . 

In loop a, the plot information function 
management unit 51 compares the inputted identifier 
pfk with the identifier of one plot information 
function 52 (step S31) . If the identifiers match, 
the plot information function management unit 51 
outputs a plot information function 52 corresponding 
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to the identifier pfk (step S32) and terminates the 
process. If the identifiers do not match, the plot 
information function management unit 51 repeats a 
process of comparing the identifier pfk with the 
5 identifier of a subsequent plot information function 
52 . 

Fig. 11 shows a dynamic image composition 
process in the case where the configuration shown 
in Fig. 3 is used. The plot information string 

10 management unit 31 shown in Fig. 11 stores one or 
more plot information strings 32 in the form of a 
list, and these plot information strings 32 are 
identified by identifiers. Each plot information 
string 32 includes a string of discrete times and 

15 plot coordinate values. 

The list 61, event variable 62 and update 
interval 63 of the plotting unit 12, and the image 
data 64, last plot coordinates 65 and plot 
coordinates 66 of the image management unit 11 are 

20 the same as those shown in Fig. 6. Each plot 
information generating unit # i ( i = l , 2 , . . . , N ) stores 
an information string identifier IDk ( k=l , 2 , . . . ,K) 
instead of the plot information function identifier 
shown in Fig. 6. 

25 Since the identifier IDk corresponds to the 
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plot information string 32 of the plot information 
string management unit 31, each plot information 
generating unit 23 can refer to an arbitrary plot 
information string 32. Therefore, one plot 
5 information string 32 can sometimes be referred by 
a plurality of plot information generating units 
23 in one image management unit 11 and can sometimes 
be referred by the respective plot information 
generating units 23 in a plurality of image 
10 management units 11. 

The plot information generating unit #i stores 
a difference calculation flag bDiffi as one of the 
parameters. The plot information generating unit 
#i adds a difference to inputted plot coordinates 
15 and outputs the coordinates if this bDiffi value 
is true, and it outputs absolute plot coordinates 
regardless of inputted plot coordinates if the bDiffi 
value is false. 

The plot update process of the dynamic image 
20 composition apparatus shown in Fig. 11 is basically 
the same as that shown in Fig. 7. However, in step 
S3 shown in Fig. 7, the highest-order plot 
information generating unit #1 executes the plot 
information generating process shown in Fig . 12 using 
25 both an update interval dt and plot coordinates (x, 
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y) as inputs and it outputs the updated plot 
coordinates (x, y) . 

The plot information generating unit #1 first 
converts the update interval dt to an internal update 
interval dtl by multiplying the update interval dt 
by a parameter speedl (step S41) and obtains a plot 
information string corresponding to a plot 
information string identifier IDl (step S42) . This 
plot information string obtaining process is 
described later. 

Then, the plot information generating unit #1 
obtains coordinate values at times before and after 
t_lastl and t_lastl+dtl, and calculates the 
coordinate change difference (dx, dy) between 
t_lastl and t_lastl + dtl by interpolation using those 
coordinate values (step S43) . This difference (dx, 
dy) corresponds to the movement amount of an image 
during the internal update interval dtl. 

For example, if the plot information string 
shown in Fig. 13 is obtained, the difference (dx, 
dy) is calculated as follows. However, it is assumed 
that tl<t2<t3<. . .<tJ is satisfied, xl, x2, x3, 
xJare different andyl, y2 , y3, . . . , yJ are different . 

First, in the case of 

tl<t lastl<t_lastl+dtl<t2, the difference (dx, dy) 
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is calculated according to the following equations. 
dx= (x2-xl) *dtl/ (t2-tl) 

dy= (y2-yl) *dtl/ (t2-tl) (3) 

In the case of 

tl<t_lastl<t2<. . .<t j<t_lastl+dtl<t ( j+1) , the 
difference (dx, dy) is calculated according to the 
following equations. 

dx=(x2-xl) * (t2-t_lastl) / (t2 - tl) 
+x j -x2 

+ (x ( j+1) -xj ) * (t_lastl+dtl-t j ) / (t ( j+1) -t j ) 
dy= (y2-yl) * (t2-t_lastl) / (t2-tl) 

(4) 

+yj-y2 

+ (y ( j+1) -yj ) * (t_lastl+dtl-t j ) / (t ( j+1) -t j ) 

In the case of t_lastl<t J<t_last 1+dt 1 , the 
difference (dx, dy) is calculated according to the 
following equations. 



dx=(xJ-x(J-l) ) * (tJ-t_lastl) / (tJ-t (J-l) ) 
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dy= (yJ-y ( J-l) ) * ( t J-t_lastl ) / (t J-t ( J-l) ) 

(5) 

In the case of t_lastl>t J, the difference (dx, 
5 dy) is calculated according to the following 
equations . 

dx=0 

dy=0 (6) 

10 

Although these equations (3), (4), (5) and (6) 
are an example of linear interpolation, a more 
complex interpolation method can also be used when 
a difference (dx, dy) is obtained from plot 

15 information string data. 

After the difference (dx, dy) is obtained, the 
plot information generating unit #1 multiplies 
coordinates dx and dy by parameters x_scalel and 
y_scalel, respectively, and assigns the results to 

20 coordinates dx and dy, respectively (step S44) . Then, 
the plot information generating unit #1 judges the 
value of the difference calculation flag bDiffl (step 
S45) . 

If the value of the flag bDiffl is true, the 
25 plot information generating unit #1 adds the 
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difference (dx, dy) to inputted plot coordinates 
(x, y) and assigns the result to the coordinates 
(x, y) (step S46) . If the value of the flag bDiffl 
is false, the plot information generating unit #1 
5 assigns the difference (dx, dy) to the coordinates 
(x, y) with no addition (step S47) . In this case, 
the inputted plot coordinates (x, y) are cancelled 
and new coordinates (x, y) are generated. 

Then, the plot information generating unit #1 

10 updates the internal time by assigning 
t_lastl=t_lastl+dtl (step S48) and judges whether 
there is a lower-order plot information generating 
unit 23 (step S49) . If there is no lower-order plot 
information generating unit 23, the plot information 

15 generating unit #1 outputs the plot coordinates (x, 
y) as a result of one update process. 

If there is a lower-order information 
generating unit 23, the plot information generating 
unit #1 calls up the lower-order information 

20 generating unit 23, provides the lower-order 
information generating unit 23 with both the update 
interval dt and obtained plot coordinates (x, y) 
as inputs and makes the lower-order information 
generating unit 23 execute the same plot information 

25 generating process (step S50) . In this case, the 
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plot information generating process shown in Fig. 
12 is recurrently called up and the process of the 
plot information generating unit #i is executed. 

In this case, the plot information generating 
5 unit #i calculates dtl=dt*speedi in step S41, obtains 
a plot information string corresponding to the 
identifier IDk in step S42 and calculates the 
coordinate change difference (dx, dy) between 
t_lasti and t_lasti + dtl based on the plot information 

10 string. 

The plot information generating unit #i also 
calculates x=x*x_scalei and y=y*y_scalei in step 
S44, also judges the value of the difference 
calculation flagbDiffi in step S45, also calculates 

15 t_lasti=t_lasti+dtl in step S48 and judges whether 
there is a pointer lpi in step S49. 

If in step S49 there is a lower-order plot 
information generating unit 23 , theplot information 
generating unit #i calls up the lower-order plot 

20 information generating unit 23. If there is no 
lower-order plot information generating unit 23, 
the plot information generating unit #i outputs the 
plot coordinates (x, y) to the original higher-order 
plot information generating unit 23 and terminates 

25 the process . 
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On receipt of the plot coordinates from the 
lower-order plot information generating unit 23, 
the higher-order plot information generating unit 
23 sequentially passes the plot coordinates to 
5 another higher-order plot information generating 
unit 23. The highest-order plot information 
generating unit #1 outputs the received plot 
coordinates as a result of one update process. By 
such a plot information generating process, the 

10 plot information generating unit 23 can generate 
plot information using a plot information string 
instead of a plot information function. 

Fig. 14 is a flowchart showing the plot 
information string obtaining process in step S42 

15 shown in Fig. 12. When the plot information 
generating unit #i passes the identifier IDk to the 
plot information st ring management unit 31, the plot 
information string management unit 31 executes a 
loop a process. Loop a is repeated K times 

20 corresponding to the number of the plot information 
strings 32 . 

In loop a, the plot information string 
management unit 31 compares the inputted identifier 
IDk with the identifier of one plot information 
25 string 32 (step S51) . If the identifiers match, the 
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plot information string management unit 31 outputs 
a plot information string 32 corresponding to the 
identifier IDk (stepS52) , and terminates the process 
If the identifiers do not match, the plot information 
5 string management unit 31 repeats the process of 
comparing the identifier IDk with the identifier 
of a subsequent plot information string 32. 

According to the dynamic image composition 

10 apparatus shown in Figs. 6 and 11, each plot 
information generating unit 23 can cancel plot 
information passed from a higher-order plot 
information generating unit 23 and can generate a 
new piece of plot information . Therefore, for example 

15 the movement of an image can also be stopped at a 
specific predetermined time. 

Generally, if each plot information generating 
unit 23 generates absolute plot information using 
the plot information from a higher-order plot 

20 information generating unit 23 as an input, plot 
information outputted from the image management unit 
11 is affected by the operation order of the plot 
information generating unit 23. 

For example, a case is considered where the 

25 image management unit 11 includes two plot 
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information generating units #1 and #2, the plot 
information generating unit #1 generates the plot 
information about a vertical vibration on a screen 
and the plot information generating unit #2 generates 
5 plot information which moves rightward between time 
0 and time tl and stops at time tl. 

In this case, the plot information generating 
units #1 and #2 are operated in that order. Lastly, 
plot information of an image which moves rightward 

10 while vertically vibrating between times 0 and tl 
and stops there at and after time tl, is outputted. 
If the plot information generating units #2 and #1 
are operated in that order, lastly, plot information 
of an image which moves rightward while vertically 

15 vibrating between times 0 and tl and it vertically 
vibrates there at and after time tl, is outputted. 
Therefore, the composition movement differs 
depending on the operation order of the plot 
information generating units #1 and #2. 

20 Fig. 15 shows the dynamic image composition 

process in the case where a plot information function 
52 is used instead of a plot information string 32 
in the configuration shown in Fig. 5. The pointer 
list 61, event variable 62 and update interval 63 

25 of the plotting unit 12; the image data 64, last 
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plot coordinates 65 and plot coordinates 66 of the 
image management unit 11; information stored in the 
plot information generating units 41; and the plot 
information function management 51 which are all 
5 shown in Fig. 15 are the same as those shown in Fig. 
6. 

Each image management unit 11 also stores 
difference coordinates 67 and further stores one 
or more plot information generating units 41 in the 

10 form of a list. 

Fig. 16 is a flowchart showing the plot update 
process of the dynamic image composition apparatus 
shown in Fig. 15. Byoneplot update process, M pieces 
of image data of the image management units #1-#M 

15 are sequentially plotted on coordinates generated 
by the plot information generating units #1-#N. A 
loop a corresponds to a process of calling up each 
image management unit 11 and is repeated M times. 
A loop b corresponds to a process of calling up each 

20 plot information generating unit 41 and is repeated 
N times. 

In loop a, the image management unit 1 1 executes 
the event process shown in Fig. 8 (step S61) , assigns 
the last plot coordinates (x_last, y_last) at a 
25 previous time to plot coordinates (x, y) (step S62) 
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and executes the process of loop b. 

In loop b, the plot information generating unit 
41 is called up, and coordinate change difference 
(dx, dy) during an update interval dt is calculated 
5 (step S63). The details of this plot information 
generating process are described later. Then, the 
obtained difference (dx, dy) is added to the plot 
coordinates (x, y) , and the result is assigned to 
the plot coordinates (x, y) (step S64) . 

10 As for loop b, lower-order plot information 

generating units #(i+l) can be sequentially called 
up tracing a pointer lpi from the highest-order plot 
information generating unit #1 or the plot 
information generating units #1-#N can be operated 

15 in parallel. 

After the loop b processes of all plot 
information generating units 41 are completed, the 
image management unit 11 assigns the obtained 
coordinates (x, y) to coordinates (x_last, y_last) 

20 (step S65) , and the plotting unit 12 plots the image 
data 64 at the position of the plot coordinates (x, 
y) (step S66) . 

After the loop a processes of all image 
management units 11 are completed, the plotting unit 

25 12 clears the variable Event to receive a new event 
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notice (step S67) and terminates the process. 

Fig. 17 is a flowchart showing the plot 
information generating process in step S63 shown 
in Fig. 16. The plot information generating unit 
5 #i executes a process using an update interval dt 
as an input and outputs a plot coordinate difference 
(dx, dy) . 

The plot information generating unit #i first 
multiplies the update interval dt by a parameter 

10 speedi and converts the update interval dt to an 
internal update interval dtl (step S71) . Then, the 
plot information generating unit #i obtains a plot 
information function fk(t) corresponding to a plot 
information function identifier pfk from the plot 

15 information function management unit 51 by executing 
the plot information function obtaining process 
shown in Fig. 10 (step S72) . Here, it is assumed 
that fk(t) is expressed by the following equation. 

20 f k(t) = (f kx (t) , fky(t)) (7) 

The plot information generating unit #i calculates 
the difference (dx, dy) according to the following 
equation using both an internal time t_lastl 
25 calculated at a previous time and the internal update 
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interval dtl (step S73) . 

dx=f kx (t_lasti+dtl) -f kx (t_lasti) 
5 dy=f ky ( t_last i+dt 1 ) -f ky (t_lasti) (8) 

Equation (8) indicates the respective 
differences of functions fkx(t) and fky(t) between 

10 internal times t_lasti and t_lasti+dtl. 

Then, the plot information generating unit #i 
multiplies the obtained differences (dx, dy) by 
parameters x_scalei and y_scalei , respectively, and 
the results are assigned to the differences dx and 

15 dy, respectively (step S74). Then, the plot 
information generating unit #i updates the internal 
time by assigning t_lasti=t_last i+dt 1 (step S75), 
outputs the difference (dx, dy) and terminates the 
proces s . 

20 The difference (dx, dy) outputted by each plot 

information generating unit #i is added to the plot 
coordinates (x, y) in step S64 shown in Fig. 16 and 
lastly the plot coordinates (x, y) are updated by 
the sum of differences (dx, dy) outputted by all 

25 plot information generating units 41. 
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By such a plot information generating process, 
a plurality of pieces of plot information generated 
by a plurality of plot information generating units 
41 can be combined in real time when an image is 
5 updated and they can be provided to the plotting 
unit 12 . Therefore, the complex movement of an image 
can be easily generated by automatically repeating 
the update of the image. 

Fig. 18 shows the dynamic image composition 

10 process in the case of the configuration shown in 
Fig. 5. The pointer list 61, event variable 62 and 
update interval 63 of the plotting unit 12; and the 
image data 64, last plot coordinates 65, plot 
coordinates 66 and difference coordinates 67 of the 

15 image management unit 11 shown in Fig. 18 are the 
same as those shown in Fig. 15. Both pieces of 
information stored in the plot information 
generating unit 41 and the plot information string 
management unit 31 are the same as those shown in 

20 Fig. 11. However, the plot information generating 
unit 41 does not store a difference calculation flag. 

The plot update process of the dynamic image 
composition apparatus shown in Fig. 18 is basically 
the same as that shown in Fig. 16. However, in step 

25 S63 shown in Fig . 16, the plot information generating 
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unit 41 executes the plot information generating 
process shown in Fig. 19 using an update interval 
dt as an input and outputs plot coordinate difference 
(dx, dy) . 

5 The plot information generating unit #i first 

multiplies the update interval dt by a parameter 
speedi, converts the update interval dt to an 
internal update interval dtl (step S81) and obtains 
a plot information string corresponding to a plot 

10 information identifier IDk from the plot information 
string management unit 31 by executing the plot 
information string obtaining process shown in Fig. 
14 (step S82) . 

Then, the plot information generating unit #i 

15 obtains coordinate values at times before and after 
t_lasti and t_lasti+dtl from the plot information 
string and calculates the coordinate change 
difference (dx, dy) between t_lasti and t_lasti + dtl 
by performing interpolation using these coordinate 

20 values (step S83) . 

Then, the plot information generating unit #i 
multiplies the obtained differences dx and dy by 
parameters x_scalei and y_scalei , respectively, and 
assigns the results to the differences dx and dy 

25 (step S84). Then, the plot information generating 
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unit #i updates an internal time by assigning 
t_lasti=t_lasti+dtl (step S85), outputs a 
difference (dx, dy) and terminates the process. By 
such a plot information generating process, the plot 
5 information generating unit 41 can generate plot 
information using a plot information string instead 
of a plot information function. 

Although in the preferred embodiments 
described above, the pointer 61 to the image 

10 management unit 11, plot information generating 
units 23 and 41, plot information function 52 and 
plot information string 32 are stored in the form 
of a list, these can be stored in an arbitrary form 
only if it is a structure where an element can be 

15 added/deleted. 

Next, the specific example of dynamic image 
composition is described with reference to Figs. 
20 through 23. 

Fig. 20 shows a screen structure at time t = 0. 

20 On this screen, an xy coordinate system having the 
upper left corner as an origin is established and 
three images II, 12 and 13 are plotted in a state 
where a plot position (x, y) is changed as time 
elapses . 

25 Fig. 21 shows the dynamic image composition 
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process by image management units 11 for managing 
these images. In this example, the dynamic image 
composition apparatus shown in Fig. 5 is used and 
both a plot information function 52 and a plot 
5 information string 32 are used. 

The image management unit 11 of image II stores 
image data 64, the most recent plot coordinates (xl, 
yl) and two plot information generating units #1 
and #2, the image management unit 11 of image 12 
10 stores image data 64, the most recent plot 
coordinates (x2, y2 ) and one plot information 
generating unit 41, and the image management unit 

11 of image 13 stores image data 64, the most recent 
plot coordinates (x3, y3) and one plot information 

15 generating unit 41. 

The plot information generating unit #1 of 
image II stores a plot information function 
identifier pf 1, and the plot information generating 
unit #2 stores aplot information function identifier 

20 pf2 . The plot information generating unit 41 of image 

12 stores a plot information function identifier 
pf2, and the plot information generating unit 41 
of image 13 stores a plot information string 
identifier ID1. 

25 Each plot information generating unit 41 
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calculates a position coordinate difference (dx, 
dy) using an update interval dt to be inputted and 
a stored last update time t_lasti and using a 
designated plot information function 52 or plot 
5 information string 32. In this example, the 
difference (dx, dy) is directly provided by each 
plot information function 52 and it is defined as 
follows . 

-Plot information function pfl 

10 

dx=0 

dy=100* ( sin (t_last+dt ) -sin (t_last) ) (9) 

According to this function, an x-direction 
15 difference dx is 0 and a y-direction difference dy 
is equal to 100 times the difference of sin (t) between 
times t_last and t_last + dt. As a result, this 
function indicates a vertical vibration with an 
amplitude of 100. 
20 -Plot information function pf2 

dx=10*dt 

dy=0 (10) 
25 According to this function, an x-direction 
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difference dx is equal to ten times the update 
interval dt and a y-direction difference is 0. As 
a result, this function indicates a linear shift 
which is made by 10 shifts per unit time in the 
5 x-direction (rightward) . 

The plot information string 32 includes 
position coordinates for the four vertices of a 
square with each side of 100, and a locus designated 
by the plot information string 32 indicates a 

10 clockwise shift along the four sides of the square 
with an upper left vertex as a start point. In this 
case, the difference (dx, dy) is calculated based 
on the designated locus by performing a linear 
interpolation. 

15 Each image management unit 11 calculates 

position coordinates (x, y) as follows using the 
difference (dx, dy) calculated by these plot 
information functions 52 or plot information strings 
32 . 

20 -Image management unit 11 of image II 

The plot information generating unit #1 
calculates the difference of a vertical vibration 
using a plot information function pfl and the plot 
information generating unit #2 calculates the 

25 difference of a rightward shift using a plot 
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information function pf 2 . The sum of these two 
differences becomes the change amount of position 
coordinates in one update. As a result, image 11 
moves along the locus of a sine wave. 
5 -Image management unit 11 of image 12 

The plot information generating unit 41 
calculates the difference of a rightward shift using 
a plot information function pf2 and the difference 
becomes the change amount of position coordinates 
10 in one update. As a result, image 12 linearly moves 
rightward . 

-Image management unit 11 of image 13 

The plot information generating unit 41 
calculates the difference of a shift along a square 

15 using a plot information string ID1, and the 
difference becomes the change amount of position 
coordinates in one update. As a result, image 13 
moves along a locus designated by the plot 
information string ID1. 

20 Here, a case is considered where in such a 

dynamic image composition process, notification of 
a specific event is posted at time t = l and an event 
process is executed. In this case, at time t = 0, each 
image is plotted in the initial position, as shown 

25 in Fig. 20. Between times t=0 and t=l, each image 
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moves according to a difference generated by each 
plot information generating unit 41 and added to 
the position coordinates, as shown in Fig. 22. 
Therefore, image II moves along the locus of a sine 
5 wave, image 12 linearly moves rightward and image 
13 moves along the locus of a square. 

Then, it is assumed that at time t=l, 
notification of an event is posted and the plot 

10 information generating unit #1 is requested by the 
image management unit 11 of image II to be deleted. 
In this case, the image management unit 11 of image 
II performs an event process, and the image 
information generating unit #1 is deleted. Therefore, 

15 after this, the difference of a vertical vibration 
is not generated, and only the plot information 
generating unit #2 generates differences. 

Then, between times t=l and t=2, each image 
continues to move according to a difference generated 

20 by each plot information generating unit 41 and added 
to the position coordinates, as shown in Fig. 23. 
At this time, image II stops vertically vibrating, 
and at time t = l, it linearly moves rightward while 
maintaining the y coordinate value . Image 12 linearly 

25 moves rightward and image 13 moves along the locus 
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of a square. 

If the content of the event notification at 
time t = l is a request to add a new plot information 
generating unit #3 to the image management unit 11 
5 of image II, the image management unit 11 adds the 
plot information generating unit #3. After this, 
differences generated by three plot information 
generating units #1, #2 and #3 are added and the 
position coordinates of image II is determined. 

10 By the way, the dynamic image composition 

apparatuses shown in Figs. 6, 11, 15 and 18 can be 
configured using an information processing device 
(computer) shown in Fig. 24. The information 
processing device shown in Fig. 24 comprises a CPU 

15 (central processing unit) 71, a memory 72, an input 
device 73, an output device 74, an external storage 
device 75, a medium driving device 76 and a network 
connection device 77, which are connected to one 
another by a bus 78. 

20 The memory 72 includes , for example, a ROM (read 

only memory) , RAM ( random acce s s memory ) , etc., and 
it stores a program and data used for the process. 
The CPU 71 performs necessary processes by using 
the memory 72 and executing the program. 

25 In these examples, the image management unit 
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11, plotting unit 12, image information function 
management unit 51, image information string 
management unit 31, image information generating 
units 23 and 41, etc., correspond to software 
5 components described by the program, and each 
component is stored in the specific program code 
segment of the memory 72. The list of pointers 61, 
event variable 62, update interval 63, image data 
64, last plot coordinates 65, other plot coordinates 

10 66, etc., are also stored in the memory 72. 

The input device 73 includes, for example, a 
keyboard, a pointing device , touch panel, etc., and 
it is used to input a user's instruction and 
information. Notification of an input operation to 

15 the input device 73 is also sometimes made to the 
plotting unit 12 as an event. The output device 74 
includes, for example, the VRAM 13 and display 14 
shown in Fig. 5, and it is used to output both inguiries 
to a user and composed dynamic images. 

20 The external storage device 75 includes, for 

example, a magnet ic dis k devi ce , opt ical di s k device , 
magneto-optical disk device, etc. This external 
storage device 75 can also store the program and 
data described above, and the program and data can 

25 be used by being loaded into the memory 72 , if reguired. 
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The external storage device 75 can also be used as 
a database for storing the image data 64, plot 
information function 52, plot information string 
32, etc. 

5 The medium driving device 76 drives a portable 

storage medium 79 and accesses the recorded content . 
For the portable storage medium, an arbitrary- 
computer readable storage medium, such as a memory- 
card, floppy disk, CD-ROM (compact disk read only 

10 memory) , optical disk, magneto-optical disk, etc. , 
is used. The program and data described above can 
also be stored in this portable storage medium 79, 
and can also be used by being loaded into the memory 
72, if required. 

15 The network connection device 77 communicates 

with external devices via an arbitrary network ( line ) 
such as a LAN (local area network), etc., and 
transmits/receives data accompanying the 
communications. The connection network device can 

20 also receive the program and data from an external 
device and the program and data can be used by being 
loaded 

into the memory 72, if required. 

Fig. 25 shows examples of computer readable 
25 storage media which can provide the information 
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processing device shown in Fig. 24 with the program 
and data . The program and data stored in the portable 
storage medium 79 or an external database 80 can 
be loaded into the memory 72. The CPU 71 executes 
5 necessary processes by using the data and running 
the program. 

Although in the preferred embodiments 
described above, configurations for implementing 
the image management unit 11 by software have been 

10 described, the image management unit 11 can also 
be implemented by hardware. 

Fig. 26 shows a case where a plurality of image 
management units 11 are configured by one hardware 
circuit. The image management unit shown in Fig. 

15 26 comprises a plurality of memories 81 (#1-#M), 
selectors 82 and 83 for selecting a memory 81, a 
plurality of plot information generating circuits 
84 (#1-#N) , selectors 85 and 86 for selecting a plot 
information generating circuit 84 and a control 

20 circuit 87. 

The control circuit 87 switches between the 
selectors 82 and 83 by a control signal CI, switches 
between the selectors 85 and 86 by a control signal 
C2 and controls the plot information generating 

25 circuits 84 by a control signal C3. In this example, 
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it is assumed for simplification purposes that only 
coordinates (x, y) are handled as plot information. 

The memories #1-#M correspond to the image 
management units #1-#M, respectively, described 
5 above and they store plot information obtained at 
a previous time at time t. The plot information 
generating circuits #1-#N correspond to the plot 
information generating units #1-#N, respectively, 
and are described above and perform a calculation 
10 corresponding to one movement element and output 
the plot information. If the time t, an update 
interval dt and plot coordinates (x, y) at the 
previous time are used as input, outputted plot 
coordinates (x', y') are expressed as follows. 

15 

x' = fx(t, dt, x, y) 

y' = fy(t, dt, x, y) (11) 

Above, dt corresponds to the difference between the 
20 previous time and the present time t, and fx(t, dt, 
x, y) and fy(t, dt , x, y) correspond to functions 
to generate an image movement. For example, if a 
vertical vibration is generated using sin(t), the 
following equations hold true. 

25 
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f x ( t , dt , x f y ) = x 

fy(t, dt. x, y) = y+sin (t) -sin (t-dt) (12) 

These functions can also output the history 
5 of past plot coordinates. For example, input 
coordinates (x_tl, y_tl) at time tl can be stored, 
and a function to continue to output the coordinates 
(x_tl, y_tl) after time tl can be defined. 

If the same plot information generating 

10 circuit 84 is used for a plurality of images, such 
plot coordinate data are stored in a register of 
the plot information generating circuit 84 for each 
image, and appropriate data are outputted by 
switching the register by a control signal C3 from 

15 the control circuit 87. 

When a plot update process is started at time 
t, first the selectors 82 and 83 are switched over 
by a control signal CI from the control circuit 87 
and a memory #1 is selected. Then, the selectors 

20 85 and 86 are switched over by a control signal C2 
and a plot information generating circuit #1 is 
selected. Simultaneously, the register of the plot 
information generating circuit #1 is switched by 
a control signal C3, if required, and appropriate 

25 data are selected. In this way, the plot coordinates 
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of the memory #1 are inputted to the plot information 
generating circuit #1, and the output from the plot 
information generating circuit #1 is stored in the 
memory #1. 

5 Then, the selectors 8 5 and 8 6 are switched over , 

a plot information generating circuit #2 is selected 
and the plot information is inputted from the memory 
#1 to the plot information generating circuit #2. 
Then, plot coordinates are generated in the plot 

10 information generating circuit #2 in the same way 
as in the case of the plot information generating 
circuit #1, and the plot coordinates are stored in 
the memory #1. After such an operation is repeated 
for all plot information generating circuits 84 

15 assigned to the image management unit #1, the output 
of the last plot information generating circuit 84 
is outputted as the plot information at the present 
time of the image management unit #1. At this time, 
the plot information is simultaneously stored in 

20 the memory #1. 

After the operation of the image management 
unit #1 is completed in this way, the selectors 82 
and 83 are switched over, the memory #2 is selected 
and the operation of the image management unit #2 

25 is performed in the same way. After such an operation 
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is repeated for M image management units, the plot 
update process at time t is completed. 

For example , a case is described where the image 
management unit #1 corresponding to the memory #1 
5 generates a rightward shift along the locus of a 
sine wave and the image management unit #2 
corresponding to a memory #2 generates a leftward 
shift along the locus of a sine wave. It is assumed 
that plot information generating circuits #1, #2 

10 and #3 generate the following respective movements. 

Plot information generating circuit #1: 
Vertical vibration of sin(t) 

Plot information generating circuit #2: 
Rightward linear shift 

15 Plot information generating circuit #3: 

Leftward linear shift 

In this case, the circuit shown in Fig. 26 first 
selects a memory #1 using the selectors 82 and 83, 
and it selects a plot information generating circuit 

20 #1 using the selectors 85 and 86. In this way, the 
vertical vibration of sin(t) is added to the 
coordinates of the memory #1. Then, the circuit 
selects a plot information generating circuit #2 
using the selectors 8 5 and 8 6 . Inthisway, a rightward 

25 shift is added to the plot coordinates of a memory 
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#1, and, as a result, plot coordinates in the case 
where the plot coordinates move rightward along the 
locus of a sine wave are outputted. 

Then, the circuit selects a memory #2 using 
5 the selectors 82 and 83 and it selects the plot 
information generating circuit #1 using the 
selectors 85 and 86. In this way, the vertical 
vibration of sin (t) is added to the plot coordinates 
of the memory #2. Then, the circuit selects a plot 

10 information generating circuit #3 using the 
selectors 85 and 86. In this way, a leftward shift 
is added to the coordinates of the memory #2, and, 
as a result, plot coordinates in the case where the 
plot coordinates move leftward along the locus of 

15 a sine wave are outputted. 

In this way, by switching both the memories 
81 and plot information generating circuits 84 using 
selectors, the outputs of a plurality of plot 
information generating circuits 84 can be combined 

20 and one image movement can be generated. One plot 
information generating circuit 84 can also be used 
to generate a plurality of image movements. 

As described above, the present invention is 
applicable to an arbitrary field, software or 

25 hardware, where a dynamic image moves as time elapses 
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or according to an event. The following are potential 
software applications. 

(1) Dynamic image generation software 

(2) Home page generation software and browser 
5 software 

(3) CD-ROM content generation software and 
reproduction software 

(4) Presentation generation software and 
reproduction software 

10 (5) Game generation software and game software 

For example, in a conventional multimedia 
title generation/reproduction system used for home 
page generation, etc., only one movement can be given 
to one image element. Therefore, if a vertical 

15 vibration with a rightward shift is given, the 
combined result of the two movements must be 
anticipated and prepared in advance. 

However, according to the system of the present 
invention, a vertical vibration with a rightward 

20 shift can be composed by separately generating a 
rightward shift and a vertical shift and by linking 
both to one image component when an image is 
reproduced. If this system is adopted, a movement 
can be dynamically added /deleted according to a 

25 user's instruction or time. 
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According to this system, since a rightward 
shift and a vertical vibration are separately managed 
when an image is reproduced, a movement in which 
the image starts moving rightward while vertically 
5 vibrating when the image which is moving rightward 
is clicked, and in which the image stops vertically 




vibrating when the image is clicked again, can be 
easily generated. In this case, the system can be 
configured in such a way that first a rightward shift 

10 is linked to an image component as a fundamental 
movement and a vertical vibration is added/deleted 
by a click event. According to the 

conventional system, a rightward shift and a 
rightward shift with a vertical vibration are 

15 separately configured and they are switched over 
by a click. However, if the two movements are prepared 
without concern to the continuity, there is a 
possibility that the two movements may be 
discontinued when they are switched over. 

20 If the system of the present invention is 

adopted, a multimedia title producer can handle each 
movement as a component. Since each kind of movement 
element is recorded in the completed multimedia title 
in a disassembled state, another producer can extract 

25 his/her favorite movement element from the 
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multimedia title andcanuse the element as a movement 
component . 

For example, it can be considered that a 
multimedia title including an image which moves along 
5 a specific path while vertically vibrating in a 
specific frequency includes two movement components, 
that is, a vertical vibration with a frequency and 
a shift along a path. In this case, the vertical 
vibration with a frequency can be implemented even 

10 in another multimedia title by extracting and using 
only the vertical vibration with the frequency. 
However, according to the convent ional system, since 
a movement is composed in advance when the multimedia 
title is produced, it is very difficult to extract 

15 only the vertical vibration with a frequency. 

Although in the preferred embodiments 
described above, for a plot information function, 
the vertical vibration of a sine wave and a 
lef tward/rightward linear shift are used, another 

20 arbitrary function can also be used. For example, 
the vibration of a cosine wave, a shift along a 
straight line y=ax+b, a shift along a parabola, a 
shift along a circle/ ellipse and the like can also 
be defined as a function. A plot information string 

25 is not limited to the locus of a square, and the 



61 



locus of an arbitrary shape, such as a parabola, 
circle, ellipse, etc., can also be used for a plot 
information string. 

Furthermore, plot information generated by a 
5 plot information generating unit is not limited to 
the plot position of an image and it can also be 
the enlargement /reduction ratio, rotation angle, 
color, sequential relationship, etc., of an image 
component. A more complex dynamic image can be 

10 displayed by dynamically combining these pieces of 
information . 

According to the present invention, when a 
plurality of dynamic images are displayed on a screen 
a complex movement can be easily generated by 

15 combining a plurality of movement elements. For 
example, a movement can be added/deleted in real 
time according to an event, a movement can be stopped 
or one movement element can be applied to a plurality 
of images. 
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What is claimed is: 

1. A dynamic image composition apparatus for 
combining and plotting one or more images, 
5 comprising: 

a plurality of plot information generating 
devices generating plot information used to plot 
a dynamic image; 

an image management device managing image data 
10 of each image and generating plot information at 
a present time of each image by combining one or 
more pieces of information generated by one or more 
of the plurality of the plot information generating 
devices; and 

15 a plotting device receiving the image data and 

the plot information at the present time from the 
image management device and plotting the image data 
based on the plot information at the present time. 

20 2. The dynamic image composition apparatus 
according to claim 1, wherein 

said plot information generating device 
generates absolute plot information. 

25 3. The dynamic image composition apparatus 
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according to claim 1, wherein 

said plot information generating device 
generates a difference of plot information between 
a previous time and the present time. 

5 

4. The dynamic image composition apparatus 
according to claim 1, further comprising 

a plot information function management device 
storing one or more plot information functions, 
10 wherein 

at least one of said plurality of said plot 
information generating" devices store 

identification information for referring to a plot 
information function and calculates the plot 
15 information using the plot information function 
corresponding to the identification information. 

5. The dynamic image composition apparatus 
according to claim 1, further comprising 

20 a plot information string management device 

storing one or more plot information strings 
including discrete plot information, 
wherein 

at least one of said plurality of said plot 
25 information generating devices store 
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identification information for referring to a plot 
information string and calculates the plot 
information using the plot information string 
corresponding to the identification information. 

5 

6. The dynamic image composition apparatus 
according to claim 5, wherein 

said at least one of said plurality of said 
plot information generating devices calculate the 
10 plot information by performing interpolation using 
the discrete plot information included in the plot 
information string. 

7. The dynamic image composition apparatus 
15 according to claim 1, wherein 

said plot information generating device stores 
a parameter for modifying plot information and 
calculates the plot information using the parameter . 

20 8. The dynamic image composition apparatus 
according to claim 1, wherein 

said plot information generating device 
generates as the plot information information about 
a plot position on a screen of an image. 



25 
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9. A dynamic image composition apparatus for 
combining and plotting one or more images, 
comprising : 

an image management device provided for each 
5 image, for including a plurality of sequentially 
ordered plot information generating devices for 
generating plot information used to plot a dynamic 
image, a first plot information generating device 
updating plot information at a previous time and 

10 passing the plot information to a subsequent plot 
information generating device, an intermediate plot 
information generating device updating plot 
information provided by a preceding plot information 
generating device and passing the plot information 

15 to a subsequent plot information generating device, 
and a last plot information generating device 
updating plot information provided by a preceding 
plot information generating device and generating 
plot information at a present time; and 

20 a plotting device for receiving the plot 

information at the present time from the image 
management device and plotting a corresponding image 
based on the plot information at the present time. 

25 10. The dynamic image composition apparatus 
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according to claim 9, wherein 

each plot information generating device 
generates a difference of plot information between 
the previous time and the present time, adds the 
5 difference to inputted plot information and updates 
the inputted plot information. 

11. A dynamic image composition apparatus for 
combining and plotting one or more images, 

10 comprising: 

an image management device provided for each 
image, for including a plurality of plot information 
generating devices for generating a difference of 
plot information used to plot a dynamic image between 

15 a previous time and a present time and device for 
generating plot information at the present time using 
a sum of differences generated by the plurality of 
the plot information generating devices; and 

plotting device for receiving the plot 

20 information at the present time from the image 
management device andplotting a corresponding image 
based on the plot information at the present time. 

12. A dynamic image composition apparatus for 
25 combining and plotting one or more images, 
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comprising : 

a plurality of plot information generating 
devices for generating information about a plot 
position in correspondence with a movement element 
5 which generates a movement of a dynamic image on 
a screen; 

an image management device for managing image 
data of each image and generates information about 
a plot position at a present time of each image by 

10 combining one or more pieces of information generated 
byoneormoreof theplurality of theplot information 
generating devices; and 

a plotting device for receiving the image data 
and the information about the plot position at the 

15 present time from the image management device and 
plotting image data based on the information about 
the plot position at the present time. 

13. A computer-readable storage medium on which is 
20 recorded a program for enabling a computer to execute 
a process, the process comprising: 

generating a plurality of pieces of plot 
information used to plot an image, for each image; 

generating plot information at a present time 
25 of each image by combining the plurality of pieces 
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of plot information ; and 

plotting each image based on the plot 
information at the present time. 

5 14. A computer-readable storage medium on which is 
recorded a program for enabling a computer to execute 
a process, the process comprising: 

generating plot information at a present time 
by updating plot information used to plot an image 
10 at a previous time for each image by a plurality 
of sequentially ordered plot information generating 
processes; and 

plotting each image based on the plot 
information at the present time. 

15 

15. A computer-readable storage medium on which is 
recorded a program for enabling a computer to execute 
a process, the process comprising: 

generating differences of a plurality of 
20 pieces of plot information used to plot an image 
between a previous time and a present time, for each 
image ; 

generating plot information at the present 
time of each image using a sum of the differences 
25 of the plurality of the pieces of the plot 



69 



information; and 

plotting each image based on the plot 
information at the present time. 

5 16 . A dynamic image composition method for combining 
and plotting one or more images, comprising: 

generating a plurality of pieces of plot 
information used to plot an image, for each image; 
generating plot information at a present time 
10 of each image by combining the plurality of pieces 
of plot information; and 

plotting each image based on the plot 
information at the present time. 

15 17. A dynamic image composition apparatus for 
combining and plotting one or more images, 
comprising : 

a plurality of plot information generating 
means for generating plot information used to plot 
2 0 a dynamic image; 

image management means for managing image data 
of each image and generating plot information at 
a present time of each image by combining one or 
more pieces of information generated by one or more 
25 of the plurality of the plot information generating 
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means; and 

plotting means for receiving the image data 
and the plot information at the present time from 
the image management means and plotting the image 
5 data based on the plot information at the present 
time . 

18. A dynamic image composition apparatus for 
combining and plotting one or more images, 

10 comprising: 

image management means provided for each image, 
for including a plurality of sequentially ordered 
plot information generating means for generating 
plot information used to plot a dynamic image, a 

15 first plot information generating means updating 
plot information at a previous time and passing the 
plot information to a subsequent plot information 
generating means, an intermediate plot information 
generating means updating plot information provided 

20 by a preceding plot information generating means 
and passing the plot information to a subsequent 
plot information generating means, and a last plot 
information generating means updating plot 
information provided by a preceding plot 

25 information generating means and generating plot 
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information at a present time; and 

plotting means for receiving the plot 
information at the present time from the image 
management means and plotting a corresponding image 
5 based on the plot information at the present time. 

19. A dynamic image composition apparatus for 
combining and plotting one or more images, 
comprising : 

10 image management means provided for each image, 

for including a plurality of plot information 
generating means for generating a difference of plot 
information used to plot a dynamic image between 
a previous time and a present time and means for 

15 generating plot information at the present time using 
a sum of differences generated by the plurality of 
the plot information generating means; and 

plotting means for receiving the plot 
information at the present time from the image 

20 management means and plotting a corresponding image 
based on the plot information at the present time. 
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Abstract of the Disclosure 

The movement of an image component is 
determined using the plot information, such as the 
5 position, size of the image component, etc. , at each 
time. The complex movement of each image component 
can be easily generated by providing a plurality 
of plot information generating units for each image 
component and combining a plurality of pieces of 
10 plot information generated by the plot information 
generating units when an image is reproduced. 
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